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Publication Title: 

PATTERN RECOGNITION DEVICE AND ITS METHOD AND STORAGE 
MEDIUM STORING ITS PROGRAM 



Abstract: 

Abstract of JP1 01 05208 

PROBLEM TO BE SOLVED: To fast modify a sampling position to more 
accurately recognize a pattern by sampling patterns in a nonuniform manner and 
recognizing the original pattern based on an acquired signal. SOLUTION: A 
signal processor 2701 receives an input signal that is sampled by a 
two-dimensional array sensor 2705 through an optical system 2704, processes 
the input signal by using data stored in a storage device 2702 and sends a 
desired output to an output device 2703. It also sends a signal to control an input 
parameter (the orientation and position of an optical axis) of the system 2704 to a 
moving device 2708. The device 2708 is a device which makes a 1st housing 
2706 perform two-dimensionally relative movement to a 2nd housing 2707, and 
two-dimensional movement amount is controlled by a control signal from the 
processor 2701. Even when the orientation where a recognition object pattern 
exists is not clear, the pattern can fast be acquired. 
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[00 54] Xf -y rs 3 1 2T"i3. -^SMiftr'-^ 

#rf S , d o^Kdta 1 8 1:-^ S „ 
[ 0 0 5 5 ] act. Xf-/7S 3 0 3"C3i£fr*4*lJI* 

[00 56] 4-f , Xf'/7S 5 0 1T"1£ 1 ti&Tt 

i. 

[0057] int. 7/S502 Tli. M*g= 
(sx . gy) t£ JtfcBtt* l^H «B« 



-h?h i: Pitt. JBfl&Kl^H, 2JJ5cSIBIffl 



. M D -1 , M D > 

, N„-l , N„} (18) 
T. A^Bffit>fLT&Pj«^ito^Sru1fI« 

<oi o tffiru]x^^«M^l.^^ill^T#^^ 

[004 6] Xf77S 3 0 4T't±. 
B &tf C £ MMt-f S . ■! il T* B AtXC ^>«? ^1 hlfl) 
fc RUL B(l , m, nJ&tfC (1 , m, n) COi o 1 3 o«j6i? 



, Ml • Mb) 

, N B -1 , N B } (19) 

tn** jrai l b izmi- h . ffi^uHttwauaattia 1 

[00 50] XT77S 3 0 ST'ti, I £l+lt5i«Tt 
S. Xf y7S3 0 9T1i. K;n^'L?r@^^^fc' 
•5*'*«BSEt. «iTV^4,Xf 7TS3 1 OKJtttf. 

■e a r^ttntf xf 7 r s 3 0 5 tatr. 

[00 5 1 ] X7-77S3 1 0t"i±, ^SiL^O^<50 
[0052] 



m, n, w) 



(20) 



D(l,m.n). -M^»^Md ■ N D s;iiSN D 

[ 0 0 5 8 ] Xf -/ 7 S 5 0 3 T'l±l *: 1 +1 tEJBrf 5 . 
Xf 7 7S 5 0 4 T-l WLZMttzfrb' d L . 

aiTvxh.tfffias*TL. -e 5 -cfti-wuf xf 77s 

5 0 2tMS„ 

[00 59] JTJLht i 0 - &ffl£tfclt&J»i*ai' A vrt' 
[0060] 5Jtt, Xf77S 5 0 2T"»Tta . A7J 

a^a^ia 6.ay'H7 t^oTira-r& . 

[006 1 ] Xf .y7 S 6 0 1 T\ iiSl/^/Wt^ 
t , «ltiJH««lB3RD(l ,n, n) tTftS ATJB^I ttott 

[0062] zz-&t%mtii. mmmcmmcm 
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W fc S tli»fi3l*i* t v \o X o t&& . KIT . 5£» 

cOlSH^iSfi^i^l. ™Ax#>£>Ax. -Ay*>£>Ayfc 

*<„ 

[ 0 0 6 3 ] Xf 7 7" S 6 0 2 T'y £ - N D CSJ&t h . 

dy=Ay dx=Ax 

D(l,x,y) = J] J] <9(dx,dy) I(gx+x+dx, gy+y+dy) 
dy=-Ay dx=-Ax 



[ 0 0 6 4 3 Xf7 7"S 6 0 4 T\ Mftiiff SOU^/I, 

i . 2»:7c^eK* i '(x,y)«iM«»fi&^rfitiit 

§ : 

[0065] 
W8] 



(21) 



±^1±S§if i SAM £ Wffi«IHX#T& s . 
[00 66] XT7/S60 5T*£x+ltj80f1-£. X 
T7TS6 0 6T''x^M D £S;t^t'^£$SL. 8 

1 T t itt'X-f -y 7S6 0 7 Ntt* - * ? T'ftftfxffX 
•>• •/ V Sf, 0 4MJ. 

[0 067]7f -y 7S 6 0 7 T"y£y+1 KSSf-tS . X 
t ■■> 7 s 6 0 8T"y#N D ZMltzfrk'dfrZtk&l. 8 
it^MM^I?TL, * ? ^frWitfXr 77S6 

[ 0 0 6 8 ] Xf * 7° S 3 0 6 T'W»5H(i<0!g»fi 

hi o#^m 2W7U— ;-v-k ar/iai 3t 

[ 0 0 6 9 ] 0 1 3 T\ 13 0 1 ^ATJlBfKU .13 0 

2 ^smRgmflU). 1303 imttov*- v-?i 

>A'Cfo h . ISHiflMfcOfcfcfc: l<tocWfc*S I/O > 4 . 
[00 70] ^SIWfMliffiWiW^K^^T*^ 

0. 1. 2, ^h-?n«0»»)il' / ^H=««l3BS. £ 

[00 7 1 ] m^-tll*- h V h yA^^b^/Ki. 

« = A(( «„ a, «„ ) 

[0075] ®wmm& 1 3 0 sa^7 muhml 

«;3-H7'y7c7)i:#W±. A7Jlft£D(0.*,*) t . 3- 
K7 '■•/ ^tfgttSfrO^ft^? Mi'fcoflSteff-* 

1 . «=^tij t*rt s mm* ajtti. 

[00 76] Xr~y 7"S 1 0 0 ««S*(C** 
3 AVfrUfflEU * #**ltf*T 7 7" S 
A(l,gx 1 ,gy 1 ,kmax) = 1, 
Ad.gXLgVi.k) =0, k * kmax 

[0078]7f »'7S 1 0 0 5T\ ft)£T4iPf 

<7h ad lis £ ifgJfl l- coaa* t*tJEi-s-t;w 

Ad.gxj .gyj,*) = /3 
[00 79] Xt 7/S 1 0 0 6t'm2:-M D tl55Et 
I,. Xf-'vrSl 0 0 7T'n£-N D tI£5£"f4.> 

[ o o 8 o ] xf •/ r s l o o 8 T1±. <fo£t x 0 . £ 

dP = (dP,, dP 2 , .. , dP B )T 
D(l, gxj+m.gyj+n^Wnxffi {1.2 N} £JR£fc£. 



i.2. 3<»3vmx'h<o . mm^si^/wcff 

(2. m*£+^tLTA^iit*^ttai$^l>o ftff* 
o co9i]coiiiRffi(iA^ft'fSt - -Srts . 

(I. MWffl<oW££jSi£«#t£l 3 04. fflxJfia 
9«90 5£SfclT. flia3E*t*£i:KJ:->Tft4>*i 
4. M«t. fl¥fSSU^^2t«-f-|>««MS«i. 

13 0 5. ^R(ffil97)9 0 4£JSLT. «#3S8WI> 

[0072] &'t. «*»*<OB««Sl¥Jt*ittWt 
4. 

[0073] 41". Xt'vTSlOOl T", BlV^ 

i**os&»if aj&**«dSL, f9twt77s i o 

0 2 1 . -e a T&Wtff Xt ■/ 7 S 1 0 0 5 Nttf „ 
[0074] Xf"/7S1 002T'(±. JMRlf U*OK) 

<OB(6D(0,' ,*) 1 3 0 2 fcSSl«*fJtfflfli 1 3 0 8 £ffl 
t>T. ifc*tJ: l Jo**{B't4 : 
) (22) 

1 0 04^\. fr-ftL&tmifXr-yrS 1 0 0 6^jt 
tr. 

[0077] Xf ••/ 7 S 1 0 0 4 Tli. a <?m%<» '3 *^ 

ttAtt£Ki-®s-£kiaxt'ri»t . mx-m'&i*- 

(23) 
(24) 



[0081] 
W9] 
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f(l, 1) f (1.2) ... fd.N) 
f(2,l) f(2,2) ... f(2,N) 



f Of. i) f(w,z) 



f(W,N) 



Pr(D(l, gx^gy^nM) 
Pr(D(l, gx 1 +ra ) gy 1 +n)=2) 



Pr(D(l, gx 1 +ra,gy 1 +n)=N) 



fcJt'U Pr(D(l, ax 1 +m,«y 1 +n)=N)(i. D(l, gx 1 +m,gy 1 + 
n)WX'hi>ft^Vi>i. ftoT. D(l, gxx+ui.gvi+n) [0082] Xf'V/S 1 0 0 9X\ .hifidl'Srffl^T-fe 

#2tf)fc£fc{i, dPfi(f(l,2),f(2,2) f(W,2)) T fc yU3«SSfrfoX? h/l^OT^J: ottejE-f S : 

W>> gXi+m.gyj+n,*) = A((A NEN (1), A NE „(2) W"» T >. 

WJ) = AaLid.SXi+m.gyi+n.j) dPj, Vj e { 1,2 W} (27) 



[0083] .XT-<y7"S 1 0 1 0T"nSrn+ltSlSr1"-S« 
Zt-vTS 1 0 1 1 ?ni)%miX^hfr}: : 3fr£® 
SLs jBi -Otfitf Xf"/rs 10 12^. ^TSrlt 
MXf77S 1 0 0 8^}ltf<, 

[0084] Xr-yrS 1 0 1 2t'{±m^m+ltSfrt 
6. 7 7"S1 0 1 3T"ri ! H D JSit^l.A 1 J:'3*' 

^f7 7S10G7MI». 

[ 0 0 8 5 ] mz , 04<OX^>y7S 3 0 7t|gff Stl 
SfflStf«^:fli?ra^. 014*^01 6W70- 

cD»I H ft 4 * r - ? IB!*) Hft £ t « . 
[ 0 0 8 G ] if , .Xf 7 r S 1 4 0 1 T\ flftWIK 

h;U/9(i. Mum] 7«(fC, Ift;^h?h> 



trmmVOVW-tlVl 7 0 5fcWLT. PgJfL-^2 
«-fe/l/ 1 7 0 7 JM^iS:* IT 1^6 „ 

[0087] St, Xf77"S 1 4 0 2t"m5r-dMttt 

7"S 1 4 0 3tto£-dNKtU»HttS. ^TdN = N B 
N D 

[0088] £*l&iftVnl±, 0 1 7**Hr/H 707 
£ffij£-f & BJBKA- 1 MstW)*tek IT . 17 0 
4 , 1 7 0 5 . Rtf 1 7 0 6 <D J: 3 1. IM«?ifM2r 
4"t>fctT . M^^l^lt^^Tl-fe/^H^^W 

[0089 ] Xr'/7"S 1 4 0 4-CJi. ty^tilT 
<Dtt-ICJ>l>^k EP^01 7t£^T17 04, 1 7 
0 5, 1 7 0 6 T^SilT V K|l*>klT<0 

ififlgRX(l+l, gXi+m.gyi+n) : 



X( 1+1 , gx: +m, gy j +n)= { (1 , gx 2 +m-l , gyj +n-l) , (1 , gX] +ni-l , gy x +n) , 
( 1 , gx x +m-l , gyj +n+1 ) , ( 1 , gx : +m, gyj+n-1) , 
(1 , gx : +m, gyj +ri) , (1 .gxj +m, gy! +n+l) , 
( 1 , gx x +m+l , gy 2 +n-l) , ( 1 , gx : +m+l , gy : +n) , 
(1, gXi+m+l.gy^n+l)} 
,*)£ffl^T, [0090] 
(HI 0] 



(28) 



=A(r(l!w).r(2!w) r(WM) T ) ^StS : 

y(v|w) = f] < 0(1+1, gx 1 +m,gy ] +n,v|l,j' > k\*)|A(l,j\k',*)> 

(ij',k') G {X(l+l,m,ii)-ajJc)) 

(29) 

fciEU wli-fc/Kl, j.k)«ttJB«W>— 'JT* 0 . /Ml , j,k) t WiawfflSflffRM <j (1, j,k)?:M-Cl,W 

#«ftii!r^X(l+l,gx a +m,gy 1 +n)K;|5-rS-fe;l'«Oo'fe. & : 

(1, j,k)m«-t/K:jgoTfhac3*iS. [0092] 

[00 9 1 ] ^f-7/S14 0 5tl±. -fc/Kl+1, gxl+ [nil] 
m,gyl+n)t, -ew^fMiXd+l.gXi+m.gyi+nJtS-t^-b 

f7(l,j,k)=-J] A(l,j,k,w) 2r<v|w) log {0(l+l,gx 1 +m,gy 1 +n,v |l,j,k,w)} 

w V 

+ J] A(l, j, k, w) J] 7 (v I w) logK 0(1+1, gx^n, gy^n, * 1 1, j, k, *) | A(l, j, k, *)>} 

w V 

(30) 
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[ 0 0 9 3 ] Xf 7rs 1 4 0 6 Til. ±lEffl2tif#M 

B(l,j,k) = B(l,j,k) +cr (1 , j .k) 
[0 094] 7TS 1 4 0 7X11, (30)#ettff t 
/tfflSffllfjficrd.j.k) , (l,j,k)eX(l+l,gx 1 +m,gy 1 + 

ii<\ fiUZ Kf^vs 1408^, ^ '3 X'WitltfXf 
j8 = j8 + r 

[00 96] .Xf 77'S 1 4 0 9T", C«ffl?:ig»rr 



■yTS 1 4 1 0^&tt. 
[009 5] Xf77'Sl 4 0 8X11, / 



h : 



C(l.j.k) = C(l.j.k) + 1, (l.j.k) e X(l+l.H,n) 



(33) 



Xf'/rS 1 4 1 OTIl, n£n+1fcS#rt£o Xf7"/ 

s 1 4 l lTii. ntfmzmitzfrZofriffi&l. M 

ix^txiiz-TvTs 1 4 1 2<\mfr, mix^tcWi 

tfXf-vTS 1 4 0 4A.H&, 
[00 97] Xf 77"S 1 4 1 2T'l±. lfci+lfcSEfrt 

B(l,m,n) = B(l.m,n) / C(l,ni.n), 
Vine C-M B ,M B ] CZ, 
[00 99] Xf77S14 1 5T11. MftASrfflirC 

h * /3 tlEUflrf S . 
[ 0 1 0 0 ] Xf77"S 3 1 1 T'SrfT§ft&&tt! 

[OlOUJf, Xf 77'S 18 0 1 Til. IS 1 1 

[0102] Xf77S 1 8 0 2T11. &M£f*fi£ 
••|-T?.-t&. <lcO!»UI£. [11 9cr)70— H-McfeS 

[0103] .Xf 7 rs 1901 Til. l**L£jKi;i&rt> 



[ 0 1 0 6 ] Xf 7 r S 1 9 0 4 Til. 1// 1 3 *» 
fclMEU 1 T'&(tM£Xr-y7°S 1 9 0 5^»^, 1 

[ 0 1 0 7 ] Xf77'S 1 9 0 5T"(1, niniax&lKnmaxS: 

A(l, m, n, *) = A(l, ra-mmax. n-nnax 



£„ Xf-vTS 1 4 1 3 Til. ra^'dMSj@x^^t":)^ 
£8ifiU MtX^tltiXfvTS 1 4 1 4 Nit*, KB 
IX^WfXfyTS 1 4 0 3<\M&» 
[0098] Xf77"S 1 4 14 Til, £SJW«*T- 

if C(l.i.n) * 0, 
rt£ ( — N B , N B 3 cZ (34) 
ffftfcfX'T 7 7° S 1 9 0 2 ^vjtttf o 
[0 104] Xf77'Sl 902T11, B(l.~,~)«4 

at. WEtflBXfTyS 1 9 0 3^. * 'jT&Wl 
ifXr-yTS 1 9 0 7A.1O. 

[ 0 1 0 5 ] Xf 77" S 1 9 0 3 Til, **tttfc*tJ&* 
€&Jfcl>9»^, 2<fc7cSiaifc*fJEt4 2-o*)>f yf? 

mtix^h \mmm<?) >> *> , v km tset & 9 

nmax, (35) 



(36) 



[0 108]Xf77'S1 9 06t(l (gx w .gy^,) 
[0109] Xf77S 1 9 0 7(1. Xf77S 1 9 0 

[0110] 7.T7TS 1 9 0 8T1±. il8^T7 

rs i so 2^m^mm^imi^7i-h. z<nx 
iizmi 9 Tira § ^lt v > h mmmmn-h & . 

[0111] l:l^l»«^V7N7xT(:J;^^ig^ 
*rs92 8*>^Bd4 lfc/Kt. dl^(iMATLABtV^)SM 

[0 11 23 H4 Hi, £*>y7h*iTfc5Sfit4fc 

[0113] [rfplfcfcuT . 4 1 0 1 (1. ATJSBT'fc 

*-#-Y*-?*7XZtoxX^h. 4 1 0 2(1. 



*. 4 1 o 3d. n'jim-A'). vmmz&at>w 

[0114] 4 1 0 4(1, ROMtt 0 . l*\fef-?* 
rxi?JJ*ZM&tb. 4 1 0 5(1, RAMTftO. £ 

4 1 0 6;KjO-F$ft|>Tu/7A£gd1gtS£#>^ 
7n/ 7 AxijrM«. 4 1 06(1. ffiiffl)E'l«^n 
T* D . 7 o 7 tr-r 4 X9*?)\~ Ft -f X^^t'cOlfi 

mm m k 7"o^72s^t- 9 mm t . 

[0 115] 1512 8^^113 6 (lsaccade6( • )tV^« 
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-mmiiLmmmit® 9 ts-r fc *j 0 x-h s . 
[o 1 1 6] 02 oni-FT'-v fRV&m&Vimm 

[0 117] |spj «3Vrc, M3»0VXT'^ftT 

iff. ^«Tfc*^ftT^£#^J\ ^ft-fftfl^P^h 
/H^tJfrWrrlS. i£^4MEt6*;UO«IffiT#> 

s. 

[ 0 1 1 8] HI 3c01 3 1 0 ft £ 3- F7'-y? 

wm3'mw->£m-tz. ttzmi i<n\ 70 

7T"^£ftT^3-tr/I4lJ^I{4, H2 OOl 0^£> 1 

[ 0 1 1 9 ] 02 li4. 02 0T#t 1 Oj6»6 1 3jWW 
O^T^fvO^lflBK? h^?-2&7Uliftji Lt^ffi 
Ltz i> toX't> h. i tM 2 2 1 4 t 1 5 #SI >) 

tzi>coX'fo&. 

[ 0 1 2 0 ] 03 7frtM3 8(C(4saccade6( ■ )TW 
ItiZtlXV^W . mutinf ( • mutinf 

( ■ )\mmm&m%tirx2>>'vj±xhi> 

[0 1 2 1 ] 03 9C*SflT^4extract2( ■ )t04 
Ot^^ilTV^subsampK • )(±, AflWttfr&^SW 
fMEa5-«-B(ft*WiilitS-9-7';U-^^-C**. 

[ 0 1 2 2 ] 02 2G0«^ Ml- 1 5 £A7JMifc 

(2,2)»MlTsa«:ade6( • JS-IHfl'St , 02 3 
tijrf J: atM«{4E(i(2,2)A^(20,20)M?«J 

[0123] Cft^Uifii^WlT. tfJMfil 4&tf 1 
5 * Wr (14) Ml'r (15) (4 . ttS(2, 2) CO t 
£KliPr(14)=0.5.. Pr(15)=0.5"C*0, f±ffl^>*(20,2 
0)fc»Krf£t. Pr(14)=0.0058. Pr(15)=0.9942i ft 
L:«J:'i(:. • -*«Lt^.^»T'l2iiA^7 lt:Z 

[0124] ^mmm^x im^wmm^bK) 
{zmmwrn^Mzm-x h^m^tzt-wt. ^ 

[ 0 1 2 5 ] 0 2 f«f -v r S 2 0 5 T'SgfTSftS^If 
MSK-o^T, 02 4, 02 5^02 6tcfp % -5Tl.CT 
•f 5 . 0 2 4 ISjrf J: o {Z . ^®IJ4Xf 7 T S 2 4 
0 1 cOfi^ftW! fc X7- y 7° S 2 4 0 2 <0MfEf-J1ti« 

[ o 1 2 6 ] 02 5 im*Ht9m?n j nii imx-h h 

[ 0 1 2 7 ] 41\ Xt-vTS 2 5 0 1 T'f4A7JpflU 

£ * mimmmizmm-i . tztz Lxmm mm 
ommm. 3<o(L+i)*T*st-rs. 

[ 0 1 2 8 ] Xf -/ T S 2 5 0 2 T'Ji. 1 £ 0 CKJiffr 

6. 



[ 0 1 2 9 ] Xf- yTS 2 5 0 3T'f4. ^MMIJSHM 

co o hcomim^McDmm^mmm^mi-^ . 

[0130] BIT. ff9"Jw*£tfiev\ 2 

tfjccM yf ?X(m,n)T''^JS-f S. 

[0131] Xf -y7°S 2504 T"(4. n& 1 tlS&t 
,Xf77S 2 5 0 5XU. m£ 1 fctfcj&t*. 

[ 0 1 3 2 ] Xf 7/S 2 5 0 6T14. SftHiftOn.ii) 
frX? hA*Ffl#>3- 1'7* 9 h)lb IX 

mztix \^hfrzo ^ms l . mmix^ >ft«x 

T77S2 5 08^ *^ft£ If X f 7 T S 2 5 0 7 
[ 0 1 3 3 ] Xf 77'S 2 5 0 7 l-JQ^>Mfit 

muzmmw *> %x x r? - f 7* -y ^ cbiw-* . 

[ 0 1 3 4 ] Xf 7TS 2 5 0 8 "CI1, **l*h^«K> 

mm. ttmt&mmxmmti. tommm 
mz x->x mmmmmm . ««aw3(:«i 

[0135] Xf 77 S 2 5 0 9XU, lSi+ltilERt 
S 0 Xf 7/S25 1 0'C!4, m*«3*i@i-r^S*>f 
a^Sr^SL, fii.T^ft{fXf 7 7S27 1 1^. * 

5 -e&imtfxf 77S2506 /vjatr. 

[0136] Xf 77'S 2511 tli, nSrn+ltitSWt 
S 0 Xf 7 7S2 5 1 2T14. n#3£jB*"0^*»£ 
o*»*«HtL. ili.T^ft(fXf 7 7S25 1 3^v, * 
^T'^rtmifXf 77S 2 5 0 5^«tr. 

[0137] XT77S 2 5 1 3 Til. I£l+lfc2*rt 
S„ Xf 77S2 5 1 4T'I4, l^lSrSi.T^^^A^ 
UEftL. «*.Tiftfitf»7U ^oT-^rWWi'xf >y7° 
S 2 5 0 3^MI>o 

[0138] a±.<m®iz* or. ^ffin?«arBfiMi. 

[0 13 9] ifc, n-F7'y7(Cl»$ftT^^^ft 

[0140] ±lB»f#^ftS :i-F-/7 ^(4. flits 
[ 0 1 4 1 ] 02 6(4. ±ie-^ffiMMft¥Mf-?£ 

[0142] mt. mmmmnmzf-?mim\- 

KM . 2iX7t«liUcaim (m.n) CO 3 1" > r 7 X 1" ff] v . 
T. Y(l,B,n)T'^S1-S. 

[ 0 1 4 3 3 Xf 77S 2601 T14, 12" 1 ttft^f 
So Xf >y 7°S 2 6 0 2 T'ii » n$r 1 „ Xf 

•y 7° S 2 6 0 3 T'!4. m& 1 tUB&Ti . 
[0 144] Xf ■y7°S2 6 04t"!i. tfWU ,m,n) 
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{Y(l-l,3m-l,3n-D, Y(l-1.3i-l,3n), Y(l-l,3m-1.3n+ 

1) 

Y(l-l,3m,3n-l), Y ( 1-1 , 3ra, 3n) , Y{1 -1 , 3ra, 3n+l) 
Y(l-l,3m+l,3n-l), ¥(l-l,3i+l,3n), Y(l-l,3m+l,3n+ 

1)1 

[0 14 51X7-77S26 0 5T1i. ±fdttftMS 

U SUSfratfUfXT-y 7S 2 6 0 7'V 
■f '3 -C'&ttixlfXr -y r s 2 6 0 6 'safctr. 
[ 0 1 4 6 ] Xf77S 2 6 0 6Tf±, tfJEUfc. ±12 

[0147] Xf7 7°S 2 6 0 7T"I±. nfcn+ltSBBrt 

5. X-r'yTS2 6 0 8T1i, m*i3&j8i?^|.A'fc' 
iWWU j@i.TV^{fXr7 7°S2609^. * 
') T'&ftftJf Xr y 7° S 2 6 0 4 Nffitf . 

[0 1 48] Xf--y7°S26 0 9'C(±> ri£n+lC3g#rt 

6. XT77S2 6 1 Of'ii. n# ! 3£jS;tTv»SA>t' 
5 U jB;fOtfltf*fvrS26 1 l'V * 
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Subsampl. i 



function Y=subsampl (X, s) 

[M, H]=size(X) ; 
for m=l:fix(M/s) 

for n-1: fix (N/a) 

Y (m, n) -X ( (m-1) *s+round (s/Z) . (n-1) *s+round (s/Z) ) ; 

end 
end 
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SaccadeB. m 



for rara=l:sxl 
for nn=l:syl 

if real ((mn^i*nn) dgaze/3) >=1 & real ((mmi i*nn) dgaze/3) < = sxl 
if imag((mm+i*nn)-dgaze/3)>-l & imag ((rom+i*nn) -dgaze/3) <-syl 

nSTMl (mm, nn) -STM1 (real ( (ram+i*nn) -dgaze/3) , imag ( (mm+i*nn) -dgaze/3)) ; 
end 
end 
end 
end 

STMl-nSTMl; 
STAGE1=0; 
else 

dgaze-(dxl-(3+i*3))*3~l; 
PNTl-CTRl+dxl-(3+i*3) ; 
end 

gaze-init„gaze+(PNT2-CTR2)*3"2+(PNTl-CTRl)*3~l; 
seq_gaze= [seq_gaze ;gaze] ; 
gaze 
end 
end 

% end of list 
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% includes spatial hierarchical structure. 

function [seq_gaze, seq_ycl, seq_yc2J =saccade6 (itr, init_gaze, crt) 



[-1 


-1 -1 +1 


+1 -1 -1 +1 -1 


%9 




fl -1 +1 


ll -1 -1 -1 -1 


%IQ 




-1 -1 -1 


+1 -1 +1 -1 -I 


%U 




fl -1 -1 


+1 -1 -1 -1 -I 


%15 




+1 -1 


+1 -1 -1 -1 -1 


U6 




-1 +1 -1 


+1 -1 -1 -1 +1 


X17 




-1 -1 -1 


+1 -1 -1 +1 +1 


%18 






1 -1 -1 -1 -1]; X19 



MUM00-8; 

[II. N] -size (VQMATO) ; 

VQMATO= (VQMATO. / (ones (H, 1) *sqrt (sum (VQMATO. "2)))) ; 

VQMATC1- [G 0 0 0 0 0 1 0 

0 0 0 0 0 0 0 1 

1 0 0 0 0 0 0 0 
Q 0 0 0 0 0 0 1 
0 0 1 0 0 0 0 0 
0 0 0 0 0 0 0 1 
0 0 0 0 1 0 0 0 
0 0 0 0 0 0 0 1 
0 1 0 0 0 0 0 0 
0 0 0 0 0 0 1 0 

0 0 0 0 0 0 0 1 

1 0 0 0 0 0 0 0 
0 0 0 0 0 0 0 1 
0 0 1 0 0 0 0 0 
0 0 0 0 0 0 0 1 
0 0 0 0 1 0 0 0 
0 0 0 0 0 0 0 1 
0 0 0 1 0 0 0 0 
0 0 0 0 0 0 1 0 

0 0 0 0 0 0 0 1 

1 0 0 0 0 0 0 0 
0 0 0 0 0 0 0 1 



%2 
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oy-(sy-3)/Z; 
FLG3=0; 

gaze=init_gaze; 
Level =3: 

INPUT= -l/3*ones(27) ; 
INPUT=impatch2(hs21, INPUT, M+i*14, 1. 0) ; 
INPUT-impatch2 (hs23, IKPUT, 23+i*23, 1,0); 

STMl-l/NUM00*onca(NUMOO. 1) *oncs {1 , sxl+sy 1 ) 

STM2 - 1 /NUMO 1 * ones (KUMO 1 . 1 ) *onc s ( 1 . sx 1 *s y 1 ) 

MIFl=zeros (sx, sy) ; 

MIP2-zeros (sx, sy) ; 

CTR1-- round (sxl/2) +i*round (syl/2) ; 

CTR2=round (sxl/2) +i*round (syl/2) ; 

PNT1-CTR1 ; 

PNT2-CTR2; 

seQ_gaze=ini t_gaze ; 

seq ycl- [] ; 

seq_yc2 [] ; 

STAGE1=0; 

STAGE2-0; 

for t-l:itr 
x0=extract2 (INPUT. 0. gaze. 3. 3) : 
xl=extract2 (INPUT. 0. gaze. 9, 9) ; 
xl=3ubsarapl(filtcr2(fhl, xl, same'), 3) ; 
x2-extract2 (INPUT, 0. gaze, 27, 27) ; 
x2 subsampl (filter2(fh2, x2. same'). 9) ; 
x2=mat2vec2(x2, 3, 3, 0) ; 
xl=mat2vec2(xl, 3, 3, 0) ; 
x0=mat2vecZ(x(). 3. 3. 0) : 
if sum(x0r=0 

x0=x0/sqrt(sum(xO. "2)) ; 
end 

ysll-VQMAT0'*x0; 

[ramx, mmy] -de tmax (ysO) ; 
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Saccade6. m 

ycl =[ycl;prod(sum(inat2vec2(V(lMATCl (:, 2), NUMOO, 3*3, 1). *stml) ')] ; 
ycl=Lycl;prod(sum(mat2vec2(VQMATCl (:, 3), NUMOO, 3*3, 1). *stml) ')1 ; 
ycl=[ycl;prod(sum(mat2vec2(VQMATCl (:, 4), NUMOO, 3*3, 1). *stml) ')] ; 
stml=mat2vec2(stml, NUMOO, 3*3, 0) ; 

MIFl(mm:mm+mmm, nn: :nn+nnn)=MIFl (rara:mm+nin!m. nn:nn+nnn)+mutinfl (VQMATC1, ycl, stml, 3, 3) ; 
if sura(sum(abs(MIFl)))>eps 
yycl=yycl+ycl; 

CMBMAT(mm:Dimiiiimin,nii: :nninnn)=CMBMAT(iiiin:iiiniiniiini,nn:nninnn) ( ones (3) ; 
end 
end 
end 

for m-l:sx 
for n l:sy 
if CMBMAT(m,n)==0 

CMBMATGn, n)=l; 
end 
end 
end 

MIF1--MIF1. /CMBMAT; 

if sum(yycl)>eps 

yycl=yycl/sum(yycl) ; 
else 

yycl=ones(NUM01, D/NUMOl; 
end 

(rnmx, mmyl=detmax(yycl) ; 
% if nmy>=l -eps & mmx-=-l+i* (-1) 
if ranry>=crt*l & mmx~=-Ui*(-l) 
STAGE1-1; 



STM2C:. (imag(PNT2) l)*sxl+real CPNT2) ) -yyc 1 ; 
for nr-l:l 
for n -1:1 
dys-zeros(NUM01, 1) ; 
for indx=l:NUM01 

if x2((rai2)i(ntl)*3)>=VQMATS2(indx, 1)*0.99 & x2((rai2) ) (nM)*3)<=VQMATS2(indx, 1)*1. 01 
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Saccade6. m 

dysGndx, 1)1; 
end 
end 

if sum (dys) ~=0 
dysdys/sum(dys) ; 

dys=ones(NUM01, 1) ; 

STM2(:. (imag(PNT2) iri-l)*sxlireal(PNY2) tm)=STM2(:, (imag(PNT2) inl)*sxltreal(PNT2) Hn). *dys; 
sSTM2=sum(S™2(:. (imag(PNT2) tn l)*sxl Heal (PNT2) inO) : 

1 STM2(:. (iina£(PNT2)tn-l)*sxl+real(PNT2)+ra)=s™2(:. (iraag(PNT2)+n-l)*sxl+real(PNT2)+iiO/sSTM2; 
end 
and 

MlF2-zeros (sx, sy) ; 
CMBMAT-7.eros(sx,sy) ; 



ior mra=j.:j 
for nn=l:3 
stm2=D; 
for mmni=0:2 
for nnn - 0:2 

Stm2-Lstm2 STM2(:, (mm+ 1 +mmm- 1 ) *sx 1 +nn+ 1 +nnn) J ; 
end 

yc2=prod(sura(piat2vec2(VQMATC2(: 1 O.NUM01, 3*3, 1). *stm2) ') ; 
yc2-[yc2;prod(sum(mat2vec2(V(»lATC2(:, 2), NfflOl. 3*3, 1). *stm2) ')] ; 
stm2 mal2vec2(stm2, NUM01, 3*3, 0) ; 

MlF2(mtn:rnra+imim, nn:nn+nnn) =MIF2(mm:mni-mnim, nn:nn+nnn)+mutinfl (TOMATO, yc2, stm2, 3, 3) ; 
if sum(sum(abs(MIFl)))>eps 
yyc2-yyc2tyc2; 

CMBMAT (rain : rnm+rnnun, nn : nn+nnn) -CMBMAT (mm ; mni+mffim, nn : nn+nnn) +ones (3) ; 
end 
end 
end 

for m=l:sx 
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Saccade6. m 



for n=l:sy 
if CMBMAT(ra. n)==0 

CMBMAT(m, n)=l; 
end 
end 
end 

MIF2=MIF2. /CMBMAT; 

if sum(yyc2)>eps 

yyc2=yyc2/sum(yyc2) ; 
else 

yyc2-ones(NUM02, D/NUM02; 
end 

[mmx, mmy] =detmax (yyc2) ; 
% if mmy>=l-eps & nmx~=-l+i* (-1) 
if mmy>=crt*l & m«ix~ = - 1 + i* (-1) 

STAGE2=1; 
else 
end 

seq ycl= [seq .ycl yycl] ; 
seq_yc2= [seq_yc2 yyc2] ; 
if STAGE2==1 

break ; 
else 

[dx2. dy2]=detnax(MIFZ) ; 
[dxl,dyl]=detmax(MIFl) ; 
if dxl==-l + i*(-l) |STAGE1==1 
PNT1=CTR1; 
if dx2==-l+i*(-D 
% mat2vec2(x2,3, 3, 1); 

% [dgaze, dyl]-detmax(abs(x2)) : 

% PNT2=CTR2; 
else 

dgaze=(dx2 (3 1 i*3) ) *3"2 ; 
PNT2=CTR2+dx2- (3+1*3) ; 
end 

nSTMl=l/NUMOO*ones (NUM00, i) *ones (1, sxl*syl) ; 
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% extract.2 maps a given image into siihspace of the mil ti resolution representati* 
% ¥ - extracts (X, L, a, sx, sy) 
% Y: resulting image. 
% X: an image. 

% L: a MRR level of interest. 
% a: gaze position in the complex plane. 
% sx: x size of Y. 
% sy: y-size of Y. 
function Y = extract2 (X, L, a, sx, sy) 
[M.N] - size(X) ; 
X0rg=round (M/2) t i*round (N/2) ; 
s0rg-round(sx/2)+i*round(sy/2) ; 
LOrg-round (3"L/2) +i*round (3"L/2) ; 
W=zeros(sx+2, sy+2) ; 
count=0; 
for y=l:sx+2 
for x=l :sx*-2 

cc=a+((x+i*y)-s0rg-(l+-i))*3~L; 

for dy=l:3"L 
for dx-l:3"L 
ccc=ce+ ( (dxti*dy) LOrg) ; 

if (real (ccc)>=l) & (real (ccc)<=M) & (imag (ccc) >=1) & (imag (ccc)<=N) 

W(x,y) = W(x,y) + X (real (ccc) , imag (ccc)) *3~ (-2*L) ; 
else 
end 
end 
end 
end 
end 

Y=W(2:sx+l. Z:sy+1) ; 

%Y=f ilter2 (f special (' laplacian", 0. 5). W, 'valid') ; 
% kernel--- [0 0 0;0 1 0;0 0 0] ; 
% Y=filter2(kernel, W, 'valid') ; 
% Y-T. *3"(-2*U ; 
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